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Abstract 

Our aim is to experimentally study the possibility of distinguishing between quantum sources of 
randomness — recently proved to be theoretically incomputable — and some well-known computable sources 
of pseudo-randomness. Incomputability is a necessary, but not sufficient "symptom" of "true randomness." 
We base our experimental approach on algorithmic information theory which provides characterizations of 
algorithmic random sequences in terms of the degrees of incompressibility of their finite prefixes. Algorith- 
mic random sequences are incomputable, but the converse implication is false. We have performed tests of 
randomness on pseudo-random strings (finite sequences) of length 2 32 generated with software (Mathemat- 
ica, Maple), which are cyclic (so, strongly computable), the bits of jt, which is computable, but not cyclic, 
and strings produced by quantum measurements (with the commercial device Quantis and by the Vienna 
IQOQI group). Our empirical tests indicate quantitative differences, some statistically significant, between 
computable and incomputable sources of "randomness." 
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I. INTRODUCTION 



From the 16th century onwards, following Galilei, Kepler, Leibniz, Newton and others, the 



rise of determinism culminated around the time of the French and American Revolutions with 

rj 

Laplace's research on the stability of the solar system without divine intervention [1]. In the 
late 19th century, first indications of potential limits to the pure deterministic research program 
emerged, in particular with Poincare's contribution S] to the solution of the three- [0] and 
general n-body problem [3, 5, (]], which is often considered as a precursor of chaos theory [7,81. 

Soon, and despite the reluctance and opposition of many of its creators, most notably Planck ||9|], 
Einstein [10], Schrodinger and De Brogli, quantum mechanics began to be accepted as an irre- 
ducibly probabilistic theory, postulating an indispensable "objective" (in distinction to "epis- 
temic;" cf. below) random behavior of individual particles, while their probabilities follow deter- 
ministic laws. With the rise of quantum mechanics (and later on also chaos theory), the principle 
of sufficient reason — stating that every phenomenon has its explanation and cause — had to be 
partially abandoned. Indeed, indeterminism and randomness in quantum mechanics, as postulated 
by Born, Heisenberg, Bohr and Pauli ft 1 lL p. 115] is commonly believed, accepted and canonized 
to the extent that [12] "the discovery that individual events are irreducibly random is probably one 
of the most significant findings of the twentieth century. [[. . .]] for the individual event in quantum 
physics, not only do we not know the cause, there is no cause." 

However, insufficient causation needs not be perceived merely negatively as a lack of prediction 
or control. Today it is widely acknowledged that certified randomness can be a valuable resource 



(e.g., for testing primality fl 1 3 . 



1411). and that under various circumstances a lack of randomness 

cu 
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ations 1150). The pitfalls of 



1911 . In John von Neumann's 



may have negative consequences (e.g., erroneous numerical ca 
software-generated pseudo-randomness [16] are well-known Jl5 . 
words boll : "Anyone who considers arithmetical methods of producing random digits is, of course, 
in a state of sin." 

Classical physical processes are subject to difficulties with "subjective" or "epistemic" random- 
ness (a criticism often attributed to Heisenberg jl2\) — people consider events to be random when 
they cannot detect any regularities characterizing the structure of those events, yet the events could 
still be causally described if they would know enough about the evolution of the system — or even 
bias; the typical example being coin tosses [2111. Several methods to generate random sequences 
from physical processes have been proposed [22], among them the coding of electric pulses [23], 



or semiconductor devices 11241 - 13 211 . The first book 113 311 containing a million of random digits using 
a physical source of randomness was published by The RAND Corporation in 1955 Il34ll . 

Currently there are two main sources capable of generating very fast large amounts of "random" 
bits: software-generated randomness (pseudo-randomness) and quantum randomness. Quantum 



randomness has been used as an "objective" resource of randomness throug 



h various processes, 



in particular the decay of meta-stable states (135143711 (for a criticism, see 113 811 ) or radioactive de 



cays [3 



afl,ani 



arrival times [29- 



32, 



4 ill , or the passage through some beam splitter 1142 - 



50|]. 



How different are these sources? Recently it has been proved that quantum randomness is in- 
computable (see more details in Section HTP)) . Incomputability is a necessary, but not sufficient 
"symptom" of "true randomness." Can we experimentally distinguish between quantum and com- 
putable sources of "randomness?" In what follows, we answer this question in the affirmative 
using an experimental approach based on algorithmic information theory which provides charac- 
terizations of algorithmic random sequences in terms of the degrees of incompressibility of their 
finite prefixes. Algorithmic random sequences are incomputable, but the converse implication is 
false. 

We have performed tests of randomness on pseudo-random strings (finite sequences) of length 
2 32 generated with software (Mathematica, Maple), which are cyclic (so, strongly computable), 
the bits of 71, which is computable, but not cyclic, and strings produced by quantum measurements 
(with the commercial device Quantis and by the Vienna IQOQI group). 

The paper is organized as follows. In the following section we present quantum randomness; 
in Section Hn] we present the main tests and results; Section|lV]includes our conclusions. 



II. QUANTUM RANDOMNESS 

In three distinct but intricately interlinked ways, the evolution of quantum mechanics ordained 
the abandonment of absolute determinism, and has established a clearly defined mixture of deter- 



minism and indeterminism, at least in the mainstream perception of the formalism [51 



55] 



(i) random occurrence of individial events 11561 . 



5711 or outcomes for quantized systems which 



are in a superposition of eigenstates of the hermitean operator corresponding to the observ- 
able; i.e., randomness from projection measurements on superposition states; 



(ii) complementarity, as proposed by Pauli |58|], Heisenberg, Dirac and Bohr; 
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(iii) value indefiniteness Il59h as implied by the theorems of Bell, Kochen & Specker and Green- 
berger, Home & Zeilinger I160ll . 



A. Random individual measurement outcomes 

With respect to the perception of certain individual outcomes of measurements, the year 
1926 marked the emergence of Born's acausal, indeterministic and probabilistic interpretation 
of Schrodinger's wave function as a complete and maximal description of a quantum mechanical 



state. Born states that (cf. L56, p. 866], English translation in Ref. [61, p. 54]) 1620, 



"From the standpoint of our quantum mechanics, there is no quantity which in any 
individual case causally fixes the consequence of the collision; but also experimen- 
tally we have so far no reason to believe that there are some inner properties of the 
atom which condition a definite outcome for the collision. Ought we to hope later to 
discover such properties [[. . .]] and determine them in individual cases? Or ought we 
to believe that the agreement of theory and experiment — as to the impossibility of 
prescribing conditions? I myself am inclined to give up determinism in the world of 
atoms." 

While postulating a probabilistic behavior of individual particles, Born offers a deterministic evo 



lution of the wave function (cf. 11571 p. 804], English translation in Ref. oil p. 302]) [63], 



"The motion of particles conforms to the laws of probability, but the probability itself 
is propagated in accordance with the law of causality. [This means that knowledge of 
a state in all points in a given time determines the distribution of the state at all later 
times.]" 

At the time of writing this statement Born did not specify the formal notion of "indeterminism" 
he was relating to. So far, no mathematical characterization of quantum randomness has been 
proven. In the absence of any indication to the contrary, it is mostly implicitly assumed that quan- 
tum randomness is of the strongest possible type; which amounts to postulating that the associated 
sequences are algorithmically incompressible. This does not exclude the possibility of weaker 
forms of randomness being generated by quantum measurements. 
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Random individual outcomes may occur at least in two different ways: (i) either due to a 
context mismatch between preparation and measurement, (ii) or due to an ignorance of the state 
preparation resulting in a mixed state. In what follows, we shall discuss these issues in some detail. 

We shall consider normalized states. The superscript "7"' indicates transposition. If not stated 
otherwise, we shall adopt the notation of Mermin's book on Quantum Computer Science Il64ll . A 
quantum mechanical context Il65n is a "maximal collection of co-measurable observables" consti- 
tuting a "classical mini-universe" within the nondistributive structure of quantum propositions. It 
can be formalized by a single "maximal" self-adjoint operator. Every collection of mutually com- 
patible co-measurable operators (such as projections corresponding to yes-no propositions) are 
functions of such a maximal operator (e.g., Ref. [66, Sec. 11.10, p. 90, English translation p. 173], 
Ref. [67, § 2], Ref. jggL pp. 227,228], and Ref. IfS § 84]). 



1. Mismatch between state preparation and measurement 



There might be a context mismatch between state preparation and measurement; i.e., the sys- 
tem has been prepared in a pure state corresponding to a certain context (maximal observable), 
and is measured in another, complementary (see below) context (maximal observable). In such a 
case, the state of the system — in terms of the spectral decomposition of the measurement context 
— is in a coherent superposition of at least some eigenstates of the preparation context. An "irre- 



versible" measurement |70 , 



210 "reduces" t 



re state to one of the eigenstates of the measurement 



context. According to the Born rule (e.g., 11641 Chapter 1]), the probability of the occurrence of 



any such measurement outcome labelled by i is given by the absolute square of the scalar prod- 
ucts | (\]/(|(p)| 2 between the state |<p) in which the system has been prepared and the corresponding 
eigenstate |\|/;) of the context. Other than this probabilistic law, quantum mechanics renders no 
further prediction for the occurrence of single measurement outcomes. Note that the amount of 
indeterminacy (as measured by the lack of bias of measurement outcomes formalizable in terms 
of average algorithmic information increase per outcome) increases with the "apartness" of the 
preparation and measurement properties; i.e., with the magnitude of the context mismatch. On the 
average, conjugate bases Jl^, p. 86] assure the greatest context mismatch, and hence the greatest 
degree of randomness gain per experiment. 



Quantum realizations of the method have been proposed 11421 14311 . patented 



and real- 



ized [44, Fig. 1(b)] (see also |45|]) for a delayed choice Bell-type experiment [74]. Note that 
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in the latter experimental realization, in the second modus operandi of Ir74ll . light of very low in- 
tensity — the photon production rate should be much smaller than the corresponding coherence 
time — is prepared by sending it through a linear polarizer, e.g., in the vertical direction \, which 
guarantees that (ideally) only photons in a definite, pure state corresponding to the polarization 
direction J leave the polarizer. The photons impinge on a beam- splitting polarizer, which should 
(ideally) be maximally (anti)aligned at exactly 45° (7t/4 radians) in order to yield a 50:50 ratio of 
photons polarized in either one of the two orthogonal directions f and \ conveyed in the two 
output ports and detected thereafter, respectively. 

The process can be formalized as follows. For a two-state process, a two-dimension Hilbert 
space suffices. The role of the beam splitter can be described by a very general unitary transfor- 
mation which can be represented by the product of a U(l) phase e~'$ and of a unimodular unitary 
matrix St/ (2) UM 



T(co, a, op) 



e' a cosco — e !(p sina> 



(1) 



e l(? shiro e ,a cos(0 

where — n < P,(o < n, — \ < a,cp < 5 . For our purpose, it suffices to consider a 50:50 beam 



nn , (i i\ 

splitter B76KZ9|] of the Hadamard form H = -±= I I , 



which can be obtained from the general 



form by setting (0 = | and a = [3 = y = -| in and in Eq. <0Q)- Note that H ■ H = I 2 is just the 
identity matrix in two dimensions. 

If | S) = (l,0) r and | \) = (0, l) r — alternatively, we could have used the notation |0) for 
| f), and |1) for | \) — represent certain orthogonal (linear polarization) states measured, and 
the particle has been prepared for in a (linear polarization) state 



I) = H|/) = ^(|/) + |\)) 



V2 



IS 



(2) 



which is a 50:50 superposition of both of these states, then the probability to find the particle in 
either one of the detectors corresponding to | y) and | \) is 



n(°) = Tr[|I)(H-|/)(/|]=Tr 



W = Tr[|:><:|.|\)(\|]=Tr 




2' 



2' 



and 



(3) 



that is, one obtains a 50:50 chance for the occurrence of outcome or 1, respectively. 
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In general it will be very difficult to establish and maintain an exact (anti)alignment of the po- 
larizers, resulting in a bias towards either state | y) or | \). If and only if this bias is stationary 
and the events are independent; i.e., uncorrected, then the bias can be eliminated after the coding 
stage by von Neumann's normalization procedure 118011 : The biased raw sequence of zeroes and 
ones is partitioned into fixed subsequences of length two; then the even parity sequences "00" and 
"11" are discarded, and only the odd parity ones "01" and "10" are kept. In a second step, the 
remaining sequences could be mapped into the single symbols 01 i — > and 10 i — > 1, thereby ex 



tracting a new unbiased sequence at the cost of a loss of original bits 



Hp. 



768] (see Refs. Ml 



82] 



83j,|84J] for a discussion of other methods). This 



for an improvement of this method, and Refs. [41, 
method fails if the events are (temporally) correlated and thus not independent. Take, for instance, 
the sequences 010101 ■■ ■ or 101010 - which in the von Neumann scheme get transformed into 
000- • • or 111 • • -. Less spectacular failures of the von Neumann normalization can be constructed 
by considering convex combinations of these cases. 

For beam splitters, the independence of outcomes required by the von Neumann normalization 
translates into the assumption that there are no temporal correlations. In view of the Hanbury 
Brown Twiss effect (cf., Ref. |85, p.313] and Ref. 18a, p. 127 ff]), this assumption is highly non- 
trivial, as effects of photon bunching might disturb the assumption of independence of subsequent 
"quantum coin tosses." In particular, it seems that the bit rate might affect the long term statistical 
independence. Note also that the von Neumann normalization (cf. above) would fail because of 
the lack of independence ||20l p. 768] . Indeed, for "very high" (with respect to the regime of the 
Hanbury Brown Twiss effect) data rates, independence can no longer be assumed. 



2. Ignorance resulting in a mixed state 

A second, maybe faster and technically less demanding possibility to produce quantum ran- 
dom bits does not require any preparation step, but just assumes the input state to be principally 
unknowable and indeterminate. In this case, the system is in a non-pure, mixed state, reflecting 



our ignorance about the state prepared [871, 2nd part, § 10, p. 827]. 

If the particle is in a totally mixed state, its density matrix is just proportional to the identity 
matrix pi 2 = \ (|0) (0| + 1 1} (1 1) = \ diag [(1,0)+ diag (0, 1 )] = and thus the probability to 
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find the particle in either one of the detectors corresponding to |0) and 1 1) is 
P Pl2 (0) = Tr[ P E 2 -|0)(0|]=Tr[il 2 - diag(l,0)] =i, and 

(4) 

P Pl2 (l) = Tr[ Pl2 .|l)(l|]=Tr[il 2 -diag(0,l)]=i; 

that is, one again obtains a 50:50 chance for the occurrence of outcome or 1, respectively. 

Alas, is may be difficult to certify, control and assert "ontologically objective," as compared to 
"epistemically subjective," ignorance. Indeed, the experimenter preparing the system may subjec- 
tively assume to be ignorant, whereas the system may implicitly be in a pure state with respect to 
a certain context, of which the experimenter does not possess any knowledge, nor has any control. 
Also temporal correlations may interfere with randomness. 

Note also that any beam splitter is essentially a reversible, one-to-one "translation device" 'Tun- 
neling in" particles in a certain state, thereby transforming the state and "spitting out" the particles 
in a bijective manner. This is reflected in the unitarity of its quantum mechanical description by 
the product of and Eq. (OQ). Ideally, the original signal can be reconstructed and recovered by 
the serial composition of the original beam splitter and its "inverse" beam splitter associated with 
the inverse unitary transformation. In this sense any quantum random number sequence based on 
beam splitters is as good as the original source of particles, regardless of the successive (quasi- 
irreversible) measurement by detectors. 

For the sake of demonstration, consider a "black box" which, for undisclosed reasons, con- 
tains an (unknown) cyclic particle source or, if one prefers, a mischievous demon constantly re- 
leasing particles (emanating from the black box) whose states oscillate between |0 ; ) = H|0) = 
(l/v / 2)(|0) + |l))^(l/v / 2)(l,l) r and|l / ) = H|l> = (l/v / 2)(|0>-|l>)^(l/v / 2)(l,-l) r ,with 
some frequency V, such that the state as a function of time is either (pure case) 

|cpv(0) = sin(27Wf)|0 / )+cos(2jivf)|l / ), (5) 

or (mixed case) 

p v (t) = sin(27W) |0') (0'| + cos(27W) (l'|. (6) 

If the sampling frequency (or any integer multiple thereof) of this "random" sequence does not 
coincide with the oscillation frequency V, then it may be very difficult for an experimenter to 
determine the source's regular behavior, which — through the beam splitter — translates one-to- 
one into the sequence generated, since H|0 ; ) = H ■ H|0) = |0) and H| 1') = H • H| 1) = 1 1). 
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Thus, it is not totally unjustified to state that claims of "objective" randomness have to be 
cautiously reviewed when particles emanating from an underspecified source are targeted directly 
towards some beam splitter, as seems to be the case in one of the two setups in Ref. 11441 Fig. 1(a)] 
and for other devices[88]. The quality of the quantum random sequences produced thus seems to 
depend on the quality of the light source Ii45ll in combination with the beam splitter. While "for 
all practical purposes" it may be justified to use a particular (or maybe even any type of) particle 
source in combination with a particular beam splitter, this falls short of a certified procedure to 
obtain truly random bits in accordance with Bohm's principle of indeterminacy. 



B. Complementary contexts 

Complementarity is a quantum resource for randomness which may be supporting the random 
occurrence of individual events dealing with a mismatch between state preparation and measure- 
ment, as has already been discussed in the Section Hi A 1 



indeterminism, as can be seen from finite automata Il89ll or generalized urn models 



It is, however, no sufficient criterion for 



90(1, which 



are nondistributive but still allow a classical representation 119 ll 19211. Whether or not complemen- 
tarity is a necessary criterion for quantum indeterminism seems to be debatable. For the lack of 
necessity, it may suffice to refer to some recording of individual outcomes of "irreversible" mea- 
surements associated with a "state reduction," or to some decay of a meta-stable state. Yet, in the 
first "state reduction" case, the existence of principally unpredictable outcomes seems to be linked 
to complementarity; at least from an operational point of view. And also decays of excited states, 



due to the quantum Zeno effect [93], depend on the mode of their measurement, which may be 



linked to time and energy. We shall not discuss these issues related to necessity further. 



95Q concentrate 



Early discussions of complimentary-type features of quantum mechanics [94, 
on a finite form of paradoxical self-reference among complementary observables resembling re- 
cursion theoretic diagonalization. In the words of Dirac [96, §1], 



"It is usually assumed that, by being careful, we may cut down the disturbance ac- 
companying our observation to any desired extent. The concepts of big and small are 
then purely relative and refer to the gentleness of our means of observation as well 
as to the object being described. In order to give an absolute meaning to size, such 
as is required for any theory of the ultimate structure of matter, we have to assume 
that there is a limit to the fineness of our powers of observation and the smallness of 
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the accompanying disturbance — a limit which is inherent in the nature cf things and 
can never be surpassed by improved technique or increased skill on the part of the 
observer. If the object under observation is such that the unavoidable limiting dis- 
turbance is negligible, then the object is big in the absolute sense and we may apply 
classical mechanics to it. If, on the other hand, the limiting disturbance is not negli- 
gible, then the object is small in the absolute sense and we require a new theory for 
dealing with it. 

A consequence of the preceding discussion is that we must revise our ideas of causal- 
ity. Causality applies only to a system which is left undisturbed. If a system is small, 
we cannot observe it without producing a serious disturbance and hence we cannot 
expect to find any causal connexion between the results of our observations. Causal- 
ity will still be assumed to apply to undisturbed systems and the equations which will 
be set up to describe an undisturbed system will be differential equations expressing a 
causal connexion between conditions at one time and conditions at a later time. These 
equations will be in close correspondence with the equations of classical mechanics, 
but they will be connected only indirectly with the results of observations. There is 
an unavoidable indeterminacy in the calculation of observational results, the theory 
enabling us to calculate in general only the probability of our obtaining a particular 
result when we make an observation." 



In 1933, Pauli gave the first explicit definition of complementarity stating that (cf. ||58l. p. 7], 



partial English translation in Ref. [51, p. 369]) |97D, 



"In the case of an indeterminacy of a property of a system at a certain configuration 
(at a certain state of a system), any attempt to measure the respective property (at least 
partially) annihilates the influence of the previous knowledge of system on the (pos- 
sibly statistical) propositions about possible later measurement results. [[...]] The 
impact on the system by the measurement apparatus for momentum (position) is such 
that within the limits of the uncertainty relations the value of the knowledge of the 
previous position (momentum) for the prediction of later measurements of position 
and momentum is lost. If, for this reason, the applicability of one classical concept 
stands in the relation of exclusion to that of another, we call both of these concepts 
(e.g., the position and momentum coordinates of a particle) with Bohr complemen- 

11 



tary. [[. . .]] One will see that this "complementarity" has no analogy in the classical 
statistical theory of gases, which also operates with statistical laws. This theory does 
not contain the assertion — which is only valid through the finiteness of the quan- 
tum of action — that the measurement of a system may necessarily result in a loss of 
knowledge acquired through previous measurements; i.e., the previous measurements 
can no longer be used." 

Complementarity may thus be interpreted as a subtle kind of departure from classical omni- 
science: whereas it may in principle be possible to measure any single, individual context, or any 
(classically operational) observable within (or encompassing) a context, the direct measurement 



(not involving counterfactuals in Einstein-Podolsky-Rosen type configurations [98, 99]) of two or 
more contexts, or of one context and some observable "outside" of it is impossible. 

Until the theorems by Bell, Kochen & Specker and Greenberger, Home & Zeilinger, quan- 
tum indeterminism was thus either (i) "believed" and corroborated by the "effective inability to 
disprove the contrary" (i.e., determinism), or (ii) argued by "intrinsic self -reference" and the im- 
possibility of the measurement process to act "softer than" the quantum of action h on the object. 
In the latter case, one could still believe that, contrary to (i), there exist elements of physical reality, 
which, in the sense of Einstein, Podolsky and Rosen [98] could even be measured and counterfac- 
tually [99] inferred simultaneously niOOTI . 



C. Value indefiniteness 



In deriving the quantum probabilities — which have originally been postulated by Born's rule 
as an axiom of quantum mechanics — from a buildup of classical probabilit ies within contexts in 



Hilbert spaces of dimension 



authors to derive nonlocal [59, 



greater tha n two, Gle ason's theorem ||101 



60 



74 



105 



10711 as well as local Q6VL 



0411 has m otivated many 



108 



11711 constraints on 



the existence of global truth functions (two-valued measures) on the entire domain of quantum 
observables. Bell's theorem already statistically indicated the impossibility of co-existence of 
certain observables "exceeding" a single context, e.g., by considering the statistics of listing of 
possible measurement outcomes and comparing them to the quantum expectations [59]; and the 
Kochen-Specker theorem presented a finite proof (by contradiction) of the impossibility of their 
co-existence. 

When it comes to interpreting and understanding these results, one difficulty is a fact already en- 
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countered in the study of complementarity: whereas the totality of contexts is not co-measu rable , 



107] 



any individual context is measurable. In this sense, the Kochen-Specker and related [160L 
theorems c an b e viewed to strengthen complementarity: not only is it operationally impossible 
to directly 11100m measure more than a single context (despite counterfactual measurements of two 
contexts in Einstein-Podolsky-Rosen type configurations [98, 13]) — it is provable impossible 
to consistently assume any co-existence of all quantum observables which could in principle be 
measured 115 911 . We shall refer to this as value indefiniteness. 

Of course, there are ways to "cope" with these findings quasi-classically (quasi-realistically) 
the most popular being the "contextu ality " assumpti on, which was first put forward by Bell in 
an attempt to save a kind of realism IU06L lll8Ml20ll . It mai ntains the physical existence of all 
conceivable potential observables but assumes that the Iill9ll ". . . result of an observation may 
reasonably depend not only on the state of the system . . . but also on the complete disposition of the 
apparatus," which could mean that the outcome of a measurement ma y depend on its context Ill2lll . 



Note that, due to the Born rule — derivable by Gleason's theorem [101 , 



102, 



104(1 for three- and 



higher-dimensional Hilbert space — the quantum mechanical expectation value (E) p = Tr (pis) of 
an observable corresponding to a hermitean operator E and a physical state p does not depend on 
the context; in particular, the expectation value (E) p of a proposition corresponding to a projector 
E is independent of the particular choice of basis among the continuity of orthogonal bases which 
it may belong to Ill22ll . Thus, contextuality is restricted to single, individual outcomes of potential 
measurements. Stated differently, quantum mechanics does not determine a specific measurement 
outcome of an observable, but determines the expectation value of that observable. In this respect, 
the quantum contextuality assumption is somewhat similar to Born's concept of deterministic evo- 
lution of the quantum state as compared to the indeterministic occurrence of single events; or the 
outcome dependence versus parameter independence for remote nonlocal 111 2311 correlated quan- 
tum events II 12411 . 

The Kochen-Specker theorem is a rather strong indication of value indefiniteness and thus of 



quantum indeterminism [|125|1 and randomness beyond Born's conjecture of the random occur- 
rence of individual events, and even beyond complementarity; at least for multi-context configu- 
rations where Kochen & Specker constructions are viable. 

Since a nontrivial interconnectedness of different bases is possible only for Hilbert spaces of 
dimension three onwards, the Gleason and the Kochen-Specker theorems apply only to Hilbert 
spaces of dimensions higher than two (see the related argument in Ref. [|126L p. 193]); hence value 
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indefiniteness can be proven only for systems of three or more mutually exclusive outcomes. For 
two-dimensional systems, one has still to rely purely on Born's indeterminacy postulate, solely 
backed by complementarity and the quantum uncertainty relations. We have to conclude that, as 
presently many quantum random number generators using beam splitters (also the ones utilizing 
complementarity) operate with two exclusive outcomes, they are not backed by value indefinite- 
ness in the sense of Bell, Kochen & Specker and Greenberger, Home & Zeilinger. 

One may still argue that, although the Born rule for quantum probabilities a nd ex pectations 



cannot be proven from the (more elementary) assumptions of Gleason's theorem 111261 § 7.2] for 
two-dimensional Hilbert spaces by presently known mathematical methods, this does not exclude 
the possibility that some other methods exist which would prove similar results related to value in- 
definiteness even for physical configurations with two mutually exclusive outcomes. For the sake 
of excluding this latter possibility, one should, for instance, find a counterexample (on the structure 
of quantum observables in two-dimensional Hilbert space) which (i) either is not in accordance 
with the Born rule but still in accordance with the additivity property upon which Gleasons's the- 
orem is based; (ii) or is in accordance with the Born rule but allows two-valued states which may 
or may not be sufficient for a homeomorphic embedding into a Boolean algebra. A typical coun- 
terexample of the first type would be one in which an electron spin observable, for noncollinear 



directions, would always point "up" and "down" according to some algorithmic rule 111271. pp. 70- 
72]). Formally, this is due to the fact that, for two-dimensional configurations, there exists a full, 
separating set of two-valued states. A counterexample of the second type appears to allow merely 
states which are singular only in a single pair of observables (indeed, this is true for arbitrary 
Hilbert space dimensions), and thus are insufficient for the particular purpose. 

D. Incomputability of quantum randomness and empirical testing 



In ||125H it is proved that quantum randomness is not Turing computable. More precisely, sup- 
pose that a quantum experiment produces an infinite sequence of quantum random bits. Would 
such a sequence be computable by a Turing machine? If we accept value indefiniteness as ex- 
pressed by the theorems of Bell, Kochen & Specker and Greenberger, Home & Zeilinger, then the 



answer given in Ref. 11250 is negative; even more, no Turing machine can enumerate an infinity 



of correct bits of such a sequence. For example, an infinite sequence of quantum random bits 
may start with a billion of O's, but cannot consist entirely of only O's. The infinite sequence of bits 
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010001 101 1000001 . . . (Champernowne's constant) or the binary expansion of % cannot be exactly 
reproduced by any quantum experiment. 

But is quantum randomness a "true" and "objective" form of randomness? First, and fore- 
most, there is no such thing as "true" randomness as measure-theoretical arguments show II 12811 . 
Secondly, it is an open question whether quantum randomness satisfies the requirements of algo- 
rithmic randomness Ill28ll . 

Our aim is to experimentally study the possibility of distinguishing between quantum sources of 
randomness (proved to be theoretically incomputable) and some well-known computable sources 
of pseudo-randomness. The legitimacy of the experimental approach comes from algorithmic 
information theory which provides characterizations of algorithmic random sequences in terms of 
the degrees of incompressibility of their finite prefixes. More precisely, a sequence is algorithmic 
random iff all its finite prefixes cannot be compressed by a universal prefix-free Turing machine 
by more than a fixed constant (which depends on the fixed machine and sequence and not on 
prefixes) 11281]. The degree of incompressibility of a string is measured with the prefix-complexity 
H\j (which depends on the universal prefix-free Turing machine U). The best empirical test of 
randomness would be to calculate the prefix-complexity of all prefixes of a given (long) string. 
This is impossible because the prefix-complexity is incomputable. However, there are computable, 
but weaker properties than incompressibility which can be tested on prefixes, for example, Borel 
normality (explained below). Of course, any such property is necessary, but not sufficient; hence 
the (degree of) absence of the property is significant. 

We have performed tests of randomness on pseudo-random strings (finite sequences) of length 
2 32 generated with software (Mathematica, Maple), which are not only computable, but also cyclic, 
the bits of 71, which is computable, but not cyclic, and strings produced by quantum measurements 
with the commercial device Quantis, as well as by the Vienna IQOQI group. 

The signals of the Vienna Institute for Quantum Optics and Quantum Information (IQOQI) 
group were generated with photons from a weak blue LED light source which impinged on a 
beam splitter without any polarization sensitivity with two output ports associated with the codes 
"0" and "1," respectively |44|]. There was no pre- or post-processing of the raw data stream, 
however the output was constantly monitored (the exact method is subject to a patent pending). In 
very general terms, the setup needs to be running for at least one day to reach a stable operation. 
There is a regulation mechanism which keeps track of the bias between "0" and "1," and tunes the 
random generator for perfect symmetry. Each data file was created in one continuous run of the 
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device lasting over hours. 

Our empirical tests indicate quantitative differences between computable and incomputable 
sources by examining (long, but) finite prefixes of infinite sequences. Such differences are guaran- 
teed to exist by the result in Ref lil25N . but, because computability is an asymptotic property, there 
is no guarantee that finite tests can "pick" them in the prefixes we have analyzed. We performed 
more tests than those described below, but discarded those for which the results were inconclu- 



sive (cf. Ref. Iil29l1 ). In what follows we will describe a battery of "non-standard" randomness 
tests based on coding theory and algorithmic information theory results 111 2811 which distinguish 
between the computable and incomputable sources that we sampled. 



III. RANDOMNESS TESTS 



In order to avoid some ideological or metaphysical bias, all sequences have been treated on an 
equal footing by looking with "evenly-suspended attention" at their phenomenological encoded 
phenotypes. No hidden "meaning" or "message" should be ascribed to them. This is conceptually 
related to the following scenario. 

Consider a couple of labeled "black boxes," each being the source of binary sequences, em- 
anated at a constant rate. In our case, we have two "Born boxes" operating under Born's as- 
sumption of quantum randomness (actually, Quantis is just that), a "Pi box" humming out binary 
digits of K, as well as some "Sinners" (in von Neumann's judgment |20|]) containing algorithms 
pretending to output random digits. 

Suppose that these boxes cannot be "screwed open," and no clues about the origin of the sym- 
bolic sources are otherwise obtainable from the outside in any perceivable way. Suppose further 
that somebody (either a devil, or a malign colleague, or a cleaning agent) has erased the labels 
completely. Would we be able to tell which box is which by analyzing their bit renditions alone? 
In what follows, we shall present some tentative answers to this question based on data produced 
with these boxes. 



A. Data 



Our data consist of 50 binary sample "random" strings of length 2 32 : 10 pseudo-random strings 
produced by Mathematica 6 I1130m . 10 pseudo-random strings produced by Maple 11 II 1 3 10 
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quantum random strings generated with Quantis Ill32ll . 10 quantum random strings generated by 
the Vi enna IQOQI group [| 1 3 311 . and 10 strings of 2 32 bits from the binary expansion of n obtained 
from H13411 . 

The process used to generate ten strings from n is the following. The input was given to us 
in hexadecimal format, with two decimal digits per byte; or one decimal digit per nibble. Two 
random decimal digits were selected to be omitted throughout the string 1 1 3sh The remaining dec- 
imal digits are assigned a 3-bit binary number to 7, which are output as 3 bits each. Processing 
continues until 2 32 bits are output. The input source that we downloaded had 4,200,000,000 dec- 
imal digits so potentially up to 1.008 x 10 10 bits can be extracted (which is about 2.347 x 2 32 ); 
thus almost all of these digits are needed to generate our 10 strings. The justification that these 
"proje cted" binary strings share the same randomness properties of 71 is given by the following 
result QX28J] : if in a random sequence over an alphabet {ai,. . . k > 2, we remove all occur- 
rences of a fixed symbol a ; , then the new sequence is also random (over an alphabet with k — 1 
symbols). 



B. Descriptive statistics 

Our experiments have been uniformly performed on all these fifty sample strings. The tests 
presented below can be grouped into the following classes: 

(i) Borel normality test; 

(ii) test based on Shannon's information theory; 

(iii) two tests based on algorithmic information theory; and 

(iv) test based on random walks. 

We present our test results using box-and-whisker plots which are compact graphical represen- 
tations of groups of numerical data through five characteristic summaries: test minimum value, 
first quantile (representing one fourth of the test data), median or second quantile (representing 
half of the test data), third quantile (representing three fourths of the test data), and test maximum 
value. Mean and standard deviation of the data representing the results of the tests are calculated. 
For the reader who prefers "numbers" instead of "pictures," tables containing all these seven ele- 
ments of descriptive statistics are included for all five sources. 
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Tables containing the experimenta l dat a and the programs used to generate the data can be 
downloaded from our extended paper [113611 . 



1. Borel normality test 



Borel normality was the first mathematical definition of randomness 11371]. A sequence is 
(Borel) normal if every binary string appears in the sequence with the right probability (which 
is 2~" for a string of length n). A sequence is normal if and only it is incompressible by any 
information lossless finite-state compressor [| 1 3 811 . so normal sequences are those sequences that 
appear random to any finite-state machine. 

n 

Every algorithmic random infinite sequence is Borel normal H139I1 . The converse implication 
is not true: there exist computable normal sequences (e.g. Champernowne's constant). 

Normality is invariant under finite variations: adding, removing, or changing a finite number 
of bits in any normal sequence leaves it normal. Further, if a sequence satisfies the normality 
condition for strings of length n+ 1, then it also satisfies normality for strings of length n, but the 
converse is not true. 



Normality was transposed to strings in Ref. I1139I1 . In this process one has to replace limits with 



inequalities. As a consequence, the above two properties, which are valid for sequences, are no 
longer true for strings. 

For any fixed integer m > 1, consider the alphabet B m = {0, l} m consisting of all binary strings 
of length m, and for every 1 < i < 2 m denote by N'" the number of occurrences of the lexicograph- 
ical ith binary string of length m in the string x (considered over the alphabet B m ). By \x\ m we 
denote the length of x. A string x is Borel normal if for every natural 1 < m < log 2 log 2 |jc| , 



Nf{x) 



< 



log 2 


x\ 




X 





for every 1 < j < 2 m . In Ref. Ill39ll it is shown that almost all algorithmic random strings are Borel 
normal. 

In the first test we count the maximum, minimum and difference of non- overlapping occur- 
rences of m-bit (m = 1, ... ,5) strings in each sample string. Then we tested the Borel normality 
property for each sample string and found that almost all strings pass the test, with some notable 
exceptions. We found that several of the Vienna sequences failed the expected count range for 
m = 2 and a few of the Vienna sequences were outside the expected range for m = 3 and m = 4 
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TABLE I. Statistics for the results for tests of the Borel normality property. 



Descriptive statistics min Ql median Q3 max mean sd 

Maple 22430 47170 61990 76130 94510 60210 21933.52 

Mathematica 8572 25500 40590 55650 86430 41870 23229.77 
Quantis 146800 185100 210500 226600 260000 207200 33515.65 

Vienna 77410 340200 350500 392500 260000 337100 103354.3 

% 14260 28860 40880 47860 79030 40220 17906.21 



(some less then the expected minimum count and some more than the expected maximum count). 
The only other bit sequence that was outside the expected range count was one of the Mathematica 
sequences that had a too big of a count for k = 1. Figured] depicts a box-and- whisker plot of the 
results. This is followed by statistical (numerical) details in Table HI 



4. x 10 5 - 
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Ql 1 1 1 1 1 1 

Maple Mathematica Quantis Vienna pi 

FIG. 1. (Color online) Box-and- whisker plot for the results for tests of the Borel normality property. 
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TABLE II. Statistics for average results in "sliding window" estimations of the Shannon entropy. 



Descriptive statistics min Ql median Q3 max mean sd 

Maple 0.9772 0.9781 0.9784 0.9787 0.9788 0.9783 0.0005231617 

Mathematica 0.9776 0.9781 0.9783 0.9785 0.9800 0.9783 0.0006654936 
Quantis 0.9779 0.9783 0.9783 0.9786 0.9795 0.9784 0.0004522699 
Vienna 0.9772 0.9777 0.9784 0.9790 0.9792 0.9783 0.0006955834 

% 0.9779 0.9784 0.9788 0.9790 0.9799 0.9788 0.0006062724 



2. Test based on Shannon 's information theory 



The second test computes "slidin g win dow" estimations of the Shannon entropy L„,...,L^ 
according to the method described in ll 14011 : a smaller entropy is a symptom of less randomness. 
The results are presented in Figure [2] and Table [Til 

0.98 F~ 



0.9795 



0.979 



0.9785 



0.978 
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Maple Mathematica Quantis 
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Pi 



FIG. 2. (Color online) Box-and-whisker plot for average results in "sliding window" estimations of the 
Shannon entropy. 
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3. Tests based on algorithmic information theory 



The third tes t us es the "book stack" (also known as "move to front") randomness test as pro- 
posed in Ref. 111411. 1 14211 . More compression is a symptom of less randomness. The results, 
presented in Figure [3] and Table [Till are derived from the original count, the count after the appli- 
cation of the transformation, and the difference. The key metric for this test is the count of ones 
after the transformation. The book stack encoder does not compress data but instead rewrites each 
byte with its index (from the top/front) with respect to its input characters being stacked/moved- 
to-front. Thus, if a lot of repetitions occur (i.e., a symptom of non-randomness), then the output 
contains more zeros than ones due to the sequence of indices generally being smaller numerically. 



1.4X10 6 - 
1.2xl0 6 - 

1. x 10 6 
8.X10 4 - 
6.X10 4 - 
4.X10 4 - 

2. X10 4 - 



Maple Mathematica Quantis 
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Pi 



FIG. 3. (Color online) Box-and-whisker plot for the results of the "book stack" randomness test. 



The fourth test is based solely on the behavior of algorithmic random strings (as selectors for 
Solovay-Strassen probabilistic primality test) and not on specific properties of randomness. 

To test whether a positive integer n is prime, we take k natural numbers uniformly distributed 
between 1 and n — l, inclusive, and, for each one i, check whether the predicate W(i,n) holds. If 
this is the case we say that "z is a witness of n's compositeness". If W(i,n) holds for at least one 
i then n is composite; otherwise, the test is inconclusive, but in this case if one declares n to be 
prime then the probability to be wrong is smaller than 2~ k . 
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TABLE III. Statistics for the results of the "book stack" randomness test. 



Descriptive statistics min Ql median Q3 max mean sd 

Maple 7964 34490 49220 69630 108700 53410 33068.58 

Mathematica 4508 13020 24110 43450 62570 27940 19406.03 
Quantis 28600 60480 87780 106700 156100 89990 41545.76 
Vienna 9110 38420 57720 73220 97660 53860 27938.92 

71 8551 35480 42100 52870 78410 41280 20758.46 



This is due to the fact that at least half z's from 1 to n — 1 satisfy W(i, n) if n is indeed composite, 
and none of them satisfy W(i,n) if n is prime tl43|]. Selecting k natural numbers between 1 and 
n — 1 is the same as choosing a binary string s of length n— 1 with k l's such that the zth bit is 
1 iff i is selected. Ref. [13] contains a proof that, if s is a long enough algorithmically random 
binary string, then n is prime iff Z(s,n) is true, where Z is a predicate constructed directly from 
conjunctions of negations of W J 1 44 1 . 

A Carmichael number is a composite positive integer k satisfying the congruence b k ~^ = 
l(modfc) for all integers b relative prime to k. Carmichael numbers are composite, but are dif- 
ficult to factorize and thus are "very similar" to primes; they are sometimes called pseudo-primes. 
Carmichael numbers can fool Fermat's primality test, but less the Solovay-Strassen test. With 
increasing values, Carmichael numbers become "rare" II 14511 . 

The fourth test uses Solovay-Strassen probabilistic primality test for Carmichael numbers 
(composite) with prefixes of the sample strings as the binary string s. We u sed the Solovay- 
Strassen test for all Carmichael numbers less than 10 16 — computed in Ref. 1 146 . 1 147 1 — with 
numbers selected according to increasing prefixes of each sample string till the algorithm returns 
a non-primality verdict. The metric is given by the length of the sample used to reach the correct 
verdict of non-primality for all of the 246683 Carmichael numbers less than 10 16 . [We started 
with k = 1 tests (per each Carmichael number) and increase k until the metric goal is met; as k 
increases we always use new bits (never recycle) from the sample source strings.] The results are 
presented in Figure 0] and Table ITVl 
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FIG. 4. (Color online) Box-and-whisker plot for the results based on the Solovay-Strassen probabilistic 
primality test. 

TABLE IV. Statistics for the results based on the Solovay-Strassen probabilistic primality test. 



Descriptive statistics min Ql median Q3 max mean sd 

Maple 93.0 96.0 101.0 113.5 120.0 104.9 10.57723 

Mathematica 93.0 97.0 109.0 132.3 142.0 113.5 19.60867 

Quantis 99.0 103.3 113.0 121.3 130.0 112.6 10.66875 

Vienna 82.0 100.3 104.5 109.0 119.0 103.5 11.03781 

7C 84.0 91.75 106.0 110.8 128.0 104.7 10.66875 



4. Test based on random walks 



A symptom of non-randomness of a string is detected when the plot generated by viewing a 
sample sequence as a ID random walk meanders less away from the starting point (both ways); 
hence the max-min range is the metric. 

The fifth test is based on viewing a random sequence as a ID random walk. Here the bits 
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TABLE V. Statistics for the results of the random walk tests. 



Descriptive statistics min Ql median Q3 max mean 



sd 



Maple 67640 88730 126400 162500 180500 125300 42995.59 

Mathematica 73500 84760 98110 103400 120300 96450 14685.34 

Quantis 138200 161600 209000 250200 294200 211300 55960.23 

Vienna 92070 130200 155600 167600 226900 152900 36717.55 

71 58570 70420 82800 91920 107500 82120 14833.75 



(indices along the x-axis) are interpreted as follows: l=move up, 0=move down (y-axis). This test 
measures how far away from the starting point (in either positive or negative) from the starting 
y-value of that one can reach using successive bits of the sample sequence. Figure[5]and Table IVl 
summarize the results. 
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FIG. 5. (Color online) Box-and-whisker plot for the results of the random walk tests. 
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C. Statistical analysis of randomness tests results 



In what follows statistical tests are used to compare the probability distributions of results of 
randomness tests app lied to the strings generated by the five sources. The Kolmogorov-Smirnov 
test for two samples n 14811 tries to determine if two datasets differ significantly. This test has the 
advantage of making no assumption about the distribution of data; i.e., it is non-parametric and 
distribution free. The Kolmogorov-Smirnov test returns a p-value, and the decision "the difference 
between the two datasets is statistically significant" is accepted if the p-value is less than 0.05; or, 
stated pointedly, if the probability of taking a wrong decision is less than 0.05. Exact p-values are 
only available for the two-sided two- sample tests with no ties. 

In some cases we have tried to double-check the decision "no significant differences between 
the datasets" at the price of a supplementary, plausible distribution assumption. Therefore, we 
have performed the Shapiro-Wilk test for normality [149] and, if normality is not rejected, we have 
assumed that the datasets have normal (Gaussian) distributions. In order to be able to compare the 
expected values (means) of the two samples, the Welch /-test [j 1 5QT I - which is a version of Student's 
test, has been applied. 

The Shapiro-Wilk test axamines the null hypothesis that a sample z\, ■ . . ,z n comes from a nor- 
mally distributed population. This test is appropriate for small samples, since it is not an asymp- 
totic test. As for each source ten independent strings have been studied, we have applied the 
Shapiro-Wilk test for a samp le size n = 10. 

The Welch's /-test 115011 is an adaptation of Student's /-test used with two samples having 
possibly unequal variances. It is used to test the null hypothesis that the two population means are 
equal (using a two-tailed test). 



The calculations have been performed with the software "7?" IU51I1 . In order to emphasize 
the relevance of p-values less than 0.05 associated with Kolmogorov-Smirnov, Shapiro-Wilk and 
Welch's /-tests, they are printed in boldface and discussed in the text. 



1. Borel test of normality 

The results of the Kolmogorov-Smirnov test are presented in Table IVTl 

Statistically significant differences are identified for (i) Quantis versus Maple, Maple, Mathe- 
matica and n; (ii) Vienna versus Maple, Mathematica and n; and (iii) Quantis versus Vienna. 
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TABLE VI. Kolmogorov-Smirnov test for the Borel normality tests. 



Kolmogorov-Smirnov test /7-values Mathematica Quantis Vienna n 

Maple 0.4175 < 0.0002 0.1678 

Mathematica < 10 4 0.0002 0.9945 

Quantis 0.0002 < 10" 4 

Vienna 0.0002 



Note that 

(i) Pseudorandom strings pass the Borel normality test for comparable numbers of counts, rel- 
atively small: if the angle brackets (x) stand for the statistical mean of tests on x, then 
(Maple) = 60210, (Mathematica) = 41870, (n) = 40220). 

(ii) Quantum strings pass the Borel normality test only for "much larger numbers" of counts 
((Quantis) = 207200, (Vienna) = 337100), 

As a result, the Borel normality test detects and identifies statistically significantly differences 
between all pairs of computable and incomputable sources of "randomness." 

2. Test based on Shannon 's information theory 

The results of the Kolmogorov-Smirnov test are presented in Table IVIII No significant dif- 
ferences are detected. The descriptive statistics data for the results of this test indicates almost 
identical distributions corresponding to the five sources. 

3. Tests based on algorithmic information theory 

The results of the Shapiro-Wilk test are presented in Table I Villi Since there is no clear pattern 
of normality for the data, the application of Welch's f-test is not appropriate. 

The results of the Kolmogorov-Smirnov test associated with the "book-stack" tests are enumer- 
ated in Table HXl Statistically significant differences are identified for Quantis versus Mathematica 
and 71. 
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TABLE VII. Kolmogorov-Smirnov test for Shannon's information theory tests. 



Kolmogorov-Smirnov test /j-values Mathematica Quantis Vienna n 



Maple 0.7870 0.7870 0.7870 0.1678 

Mathematica 0.7870 0.4175 0.0525 

Quantis 0.4175 0.1678 

Vienna 0.4175 



TABLE VIII. Shapiro-Wilk test for Shannon's information theory tests. 

Shapiro-Wilk test Maple Mathematica Quantis Vienna % 
rvalue 0.1962 0.0189 0.0345 0.3790 0.8774 



As more compression is a symptom of less randomness, the corresponding ranking of sam- 
ples is as follows: (Quantis) = 89988.9 > (Vienna) = 53863.8 > (Maple) = 53411.6 > (n) = 
41277.5 > (Mathematica) = 27938.3. 

The Shapiro-Wilk tests results are presented in Table IXl 

Since normality is not rejected for any string, we apply the Welch's f-test for the comparison 
of means. The results are enumerated in Table IXIl Significant differences between the means are 
identified for the following sources: (i) Quantis versus all other sources (Maple, Mathematica, 
Vienna, 7l); and (ii) Vienna versus Mathematica and Maple (as already mentioned). 

The Kolmogorov-Smirnov test results are presented in Table Kill where no significant differ- 

TABLE IX. Kolmogorov-Smirnov test for the "book-stack" tests. 
Kolmogorov-Smirnov test ^-values Mathematica Quantis Vienna ji 



Maple 0.4175 0.1678 0.9945 0.4175 

Mathematica 0.0021 0.1678 0.4175 

Quantis 0.1678 0.0123 

Vienna 0.4175 
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TABLE X. Shapiro-Wilk test for the "book-stack" tests. 



Shapiro-Wilk test Maple Mathematica Quantis Vienna 7t 
p-value 0.7880 0.4819 0.7239 0.8146 0.5172 



TABLE XI. Welch's f-test for the "book-stack" tests. 



p-value Mathematica Quantis Vienna ji 



Maple 0.0535 0.0436 0.974 0.3412 

Mathematica 0.0009 0.0283 0.1551 

Quantis 0.0368 0.0054 

Vienna 0.2690 



ences are detected. The Shapiro-Wilk test results are presented in Table IXIIII Since there is no 
clear pattern of normality for the data, the application of Welch's Mest is not appropriate. 

4. Test based on random walks 

The Kolmogorov-Smirnov test results are presented in Table IXIVl 

Statistically significant differences are identified for: (i) Quantis versus all other sources 
(Maple, Mathematica, Vienna and 7t); (ii) Vienna versus Mathematica, Vienna (as already men- 
tioned) and 7t; and (iii) Maple versus 71. 

TABLE XII. Kolmogorov-Smirnov test for the algorithmic information theory tests. 
Kolmogorov-Smirnov test /j-values Mathematica Quantis Vienna n 



Maple 0.7591 0.4005 0.7591 0.7591 

Mathematica 0.7591 0.7591 0.7591 

Quantis 0.4005 0.7591 

Vienna 0.9883 
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TABLE XIII. Shapiro-Wilk test for the algorithmic information theory tests. 



Shapiro-Wilk test Maple Mathematica Quantis Vienna 7t 
p-value 0.0696 0.0363 0.4378 0.6963 0.4315 



TABLE XIV. Kolmogorov-Smirnov test for the random walk tests. 

Kolmogorov-Smirnov test /^-values Mathematica Quantis Vienna ji 

Mathematica 0.1678 0.0123 0.4175 0.0525 

Quantis < 10 4 0.0021 0.1678 

Vienna 0.0525 < 10" 4 

7i 0.0002 



Note that quantum strings move farther away from the starting point than the pseudorandom 
strings; i.e., (Vienna) > (Quantis) > (Maple) > (Mathematica) > (tc). 

It was quite natural to double-check the conclusion "Quantis and Vienna don't exhibit sig- 
nificant difference." Hence we run the Shapiro-Wilk test which concludes that normality is not 
rejected; cf. Table IXVl 

Next, we apply the Welch's Mest for the comparison of means. The results are given in Ta- 
ble IXVTJ Significant differences between the means are identified for the following sources: (i) 
Quantis versus all other sources (Maple, Quantis, Vienna, 7l); (ii) Vienna versus Mathematica), 
Quantis (as already mentioned) and 7r; (iii) Maple versus K. 

TABLE XV. Shapiro-Wilk test for the random walk tests. 

Shapiro-Wilk test Maple Mathematica Quantis Vienna n 
p- value 0.2006 0.9268 0.5464 0.8888 0.9577 
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TABLE XVI. Welch's ?-tests for the random walk tests. 



/rvalue Mathematica Quantis Vienna 7t 



Maple 0.06961 
Mathematica 
Quantis 
Vienna 



0.0013 0.1409 0.0119 
< 10 4 0.0007 0.0435 
0.0143 < 10 4 
0.0001 



IV. CONCLUSIONS 

Our aim was to experimentally study the possibility of distinguishing between quantum sources 
of randomness — recently proved to be theoretically incomputable — and some well-known com- 
putable sources of pseudo-randomness. The experimental approach is based on algorithmic infor- 
mation theory which provides characterizations of algorithmic random sequences in terms of the 
degrees of randomness of their finite prefixes. In this theory the degree of incompressibility of a 
string is measured with the prefix-complexity, which, unfortunately, is incomputable. Fortunately, 
there are computable, but weaker properties than incompressibility which can be tested on pre- 
fixes. Of course, such a property is necessary but not sufficient, so the (degree of) absence of the 
property is significant. 

We have performed tests of randomness on pseudo-random strings (finite sequences) of length 
2 32 generated with software (Mathematica, Maple), which are cyclic (so, strongly computable), 
the bits of n, which is computable, but not cyclic, and strings produced by quantum measurements 
(with the commercial device Quantis and by the Vienna IQOQI group). 

It is important to emphasize that our aim was to find tests capable of distinguishing computable 
from incomputable sources of "randomness" by examining (long, but) finite prefixes of infinite 



sequences. Such differences are guaranteed to exist by the result in Ref [|125|l . but, because com 



putability is an asymptotic property, there was no guarantee that finite tests can "pick" them in the 



prefixes we have analyzed II152I1 . 

With these privisos, our empirical randomness tests indicate quantitative differences between 
computable and incomputable sources of "randomness;" more specifically: 

(i) pseudo-random strings perform very well on Borel normality — in fact, too well (some over- 
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estimate by more than 2% of length), while the Vienna strings — which have not been post- 
processed — indicate deviations from Borel normality for test strings of small length (up to 
length 4); 

(ii) in computing Shannon's entropy for our sequences we observe that the average seems to 
be the same for all sources. However, the Vienna sources clearly show a much flatter "Bell 
curve" around its median; the Quantis results are somewhat peculiar in that the median is 
clearly not centered within the 50% percentile of the entropies (indicating a skewed Bell 
curve) and the Mathematica sequences have a few outliers with large entropy; 

(iii) in the random walk test quantum random sources (both Vienna and Quantis) seem to move 
farther away from the starting point than the pseudo-generators. 

(iv) the test based on the correctness of probabilistic tests of primality is more "utilitarian," as the 
metric reflects the length of the sample "random" string necessary for the Solovay-Strassen 
algorithm to reach the correct answer; overall, quantum random generators appear to be 
different from pseudo-random generators; with the Vienna strings emerging as the clear 
outlier (in all tests with various degrees of confidence); 

(v) the behavior of K (computable, but not cyclic) is interesting: in tests 1, 4 and 5 the results 
are closer to Mathematica and Maple, in tests 2 and 3 the results for 71 stands out (above) of 
all others in the direction of possibly being "more" random (according to these test metrics). 

The statistical analysis of the randomness tests shows that the Borel normality test is the best 
test (from our collection) for detecting and differentiating between the computable and incom- 
putable random sources; the random walk test and the "book-stack" follow in efficiency. The 
Shannon test and the test based on probabilistic primality behavior |l28 | do not produce statisti- 
cally significant results. In the first case the reason may come from the fact that averages are the 
same for all samples. In the second case the reason may be due to the fact that the test is based 
solely on the behavior of algorithmic random strings and not on a specific property of randomness. 

The pair of tests based on Borel normality and random walks seem to address complimentary 
properties helping to distinguish well between computable and incomputable sources of "random- 
ness." Pseudo-random strings perform better than quantum strings for the Borel normality test. 
One could speculate that pseudo-randomness incorporates the "human" perception of randomness, 
which is strongly associated with uniform distribution; in contrast, quantum randomness has no 
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such bias. Quantum random bits tend to take a longer time to reach "uniform distribution" — which 
is an asymptotical property — than pseudo-random strings. 

Our analysis indicate normality of the (finite) quantum sequences for longer test strings, but 
violations of normality for a few small length test strings (up to length 4). Notice that for finite 
sequences of quantum or other origin, normality needs not be satisfied for all test strings; hence the 
derivations cannot be taken as a clear signal of a violation of Borel normality stemming, say, from 
a lack of independence. With these caveats, a conceivable (speculative and by no means necessary) 
physical explanation of this violation of normality for test strings of small length would be that, 
due to photon (Bose-Einstein) statistics and the Hanbury-Brown-Twiss effect ("photon bunching;" 
i.e., the tendency of photons to arrive in identical states), independence and thus Borel normality 
might be violated for "small" groups of data. In this line of thought, for larger sequences a sort of 
"late randomness" becomes visible, as the short-term correlations disappear in time. In contrast, 
for the random walk test, which addresses a global type of behaviour rather than a local one, 
quantum strings perform better: they tend to move farther away from the starting point. 

A few more caveats are in order. As expected, our results indicate some tendencies only. 
As this is a first attempt to experimentally distinguish computable from incomputable sources of 
"randomness," much more work is necessary to understand those differences. New tests should 
be designed to reflect the asymptotic differences. We may work with longer strings of bits to 
trespass the cyclically of the pseudo-random generators 11530. We suggest that there may be 
different types of "quantum randomness" corresponding to different forms of quantum indeter- 
minism (e.g., entanglement, Bell's theorem, Kochen-Specker theorem). Finally, our experimental 
results clearly cannot, and do not aim, to "prove" in any formal way the superiority of quantum 
random generators over the best pseudo-random ones for practical applications; the only superi- 
ority is asymptotic, and resides in the differences between computable and incomputable sources 
proven in Ref II 1 2.311 . 
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